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1.  INTRODUCTION 

'The  R2  Information  Retrieval  System,  when  complete,  will  be  a 
question-answer  information  retrieval  system  in  which  a  person,  having 
questions  over  a  pre-determined  data  base,  will  be  able  to  receive 
answers  to  his  questions. 

■Hvis  paper  concerns  the  initial  processing  of  the  data  base 
for  the  R2  system  and  explores  initially  several  simple  strategies  for 
retrieving  relevant  statements,  rather  than  answers,  for  a  given 

question  over  the  data  base. 

This  paper  is  first  concerned  with  the  construction  of 

a  "phrase  dictionary"  from  the  data  base,  and,  secondly,  with  the 
development  of  several  initial  attempts  for  information  retrieval 
from  the  data  base. 
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II.  PROGRAM  STRUCTURE  OF  R2 

The  R2  Information  Retrieval  System  in  the  form  described 
has  been  programmed  on  the  Control  Data  Corporation  (CDC)  1604  computer, 
In  the  Coordinated  Science  Laboratory  of  the  University  of  Illinois. 

Ihe  forty-eight  programs  and  subprograms  comprising  the  R2  Inf or-ution 
Retrieval  System  were  written  in  the  Information  Search  Language 
system  (ISL)  and  in  the  Illinois  Assembly  Resident  system  (ILLAR) ,  Use 
was  also  made  of  the  CDC  CO-OP  Monitor  System  for  a  generalized  alpha¬ 
betic  sort  program.  Of  the  forty-eight  routines  written,  thirty-eight 
are  used  in  the  construction  of  the  "phrase  dictionary."  Several  of 
these  routines  are  for  the  purpose  of  supplying  status  information  and 
action  requests  to  the  computer  operator.  The  remaining  ten  programs 
and  subroutines  are  incorporated  in  the  strategies  for  retrieving 
relevant  statements  in  response  to  questions  asked  over  information  in 
the  data  base  of  the  R2  system.  Appendix  A  contains  brief  descriptions 
of  the  computer  programs,  flow  charts,  and  operating  instructions  for 
the  computer  programs  for  the  construction  of  the  "phrase  dictionary"; 
Appendix  B  contains  operating  instructions  for  the  use  of  the  initial 
strategies  of  the  R2  system. 
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1  III.  COMPOSITION  OF  THE  INITIAL  R2  RETRIEVAL  SYSTEM 

i 

|  The  initial  R2  Information  Retrieval  System  is  composed  of 

I  (1)  a  data  base,  that  is,  a  set  of  sentences,  paragraphs,  and  state¬ 

ments  over  some  subject  matter;  (2)  a  "phrase  dictionary"  constructed 


(  from  the  edited  data  base;  (3)  a  set  of  strategies  for  retrieving 

t 

relevant  statements  from  a  set  of  questions;  and  (A)  a  aser  seeking 

,  ; 

1  answers  to  questions  over  information  contained  in  the  data  base. 


The  data  base  used  in  the  experimental  work  performed  on 


the  R2  system  is  described  in  chapter  IV.  The  construction  of  the 
"phrase  dictionary"  is  described  in  chapter  VI.  An  example  of  a 


portion  of  the  dictionary  is  given  in  Appendix  C.  The  six  basic 
i  strategies  composing  the  initial  strategy  set  are  discussed  in 


chapter  VII. 

S 

i 


IV.  CHOICE  OF  A  DATA  BASE 


For  the  study  of  the  information  retrieval  method  described 

herein,  the  official  Illinois  driver's  manual  "Rules  of  the  Road"  was 

/ 

chosen  for  the  data  base.  From  this  the  descriptive  "R2"  was  taken 
to  describe  the  information  retrieval  system  discussed.  The  choice  • 
of  "Rules  of  the  Road"  for  the  data  base  was  twofold:  (1)  this  data 
base  contains  factual  information  and  (2)  this  data  base  is  of  such 
length  as  to  completely  test  the  generality  of  the  R2  information 
retrieval  system. 

"Rules  of  the  Road"  consists  of  94  pages  of  factual  informa¬ 
tion--  information  of  the  type  a  person  interested  in  obtaining  a 
driver’s  license  in  Illinois  would  need  and  want  to  know.  A  person 
seeking  answers  to  questions  concerning  traffic  rules  and  regulations 
in  Illinois  could  definitely  profit  from  the  R2  retrieval  system 
applied  to  "Rules  of  the  Road"  as  its  data  base. 
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V.  EDITING  OF  THE  ORIGINAL  DATA  BASE 

The  original  data  base  requires  editing  so  as  to  conform  to 
certain  restrictions  imposed  by  the  Information  Search  Language  (ISL) 
and  also  to  handle  other  problems  described  below.  The  ISL  system 
makes  use  of  the  following  symbols:  the  minus  sign,  hyphen,  and 
dash  (-) ;  the  semicolon  (;);.and  the  colon  (:).  Hence,  the  original 
data  base  containing  such  symbols  must  be  edited  to  remove  these 
symbols.  The  first  step  in  the  editing  process  is  to  remove  all 
occurrences  of  dashes,  hyphens,  and  minuses.  The  symbols  are  either 
replaced  by  commas  or  spaces  depending  on  the  context  in  which  they 
appear.  The  semicolon  is  replaced  by  a  comma  or  the  phrases  separated 
by  the  semicolon  are  broken  into  two  sentences.  Here  again,  the  option 
depends  on  the  context  in  which  the  symbol  is  used.  Quotation  marks 
are  completely  removed.  Question  marks  in  the  data  base  are  coded  with 
the  symbol 

The  use  of  the  colon  and  the  use  of  ellipsis  periods  to 
indicate  lists  occurs  frequently  in  the  "Rules  of  the  Road."  For 
example,  consider  the  statement  from  the  "Rules  of  the  Road"  shown  in 
Figure-L-.at— the  top  of  the  next  page. _ _ _ _ 

The  coded  form  of  the  statement  shown  in  Figure  1  is  shown  in 
Figure  2.  Note  that  abbreviations,  quotation  marks,  and  hyphens  have 
been  removed  conforming  to  the  rules  of  editing  outlined  above. 


G 


PARSING  IS  PROHIBITED  ON  A  TWO -LANE  HIGHWAY... 

In  a  no-passing  area  marked  by  a  yellow  strip 
or  a  "DO  NOT  PASS"  sign. 

On  a  hill  or  a  curve  where  a  vehicle  approach¬ 
ing  from  the  opposite  direction  might  create 
a  hazard. 

- - r-Within -lOO-  ft  .—of -  an  intersection  or  rail¬ 
road  crossing. 

F igure  1 

Example  for  the  illustration  of  the  coding  of  list  structures. 


PASSING  IS  PROHIBITED  ON  A  TWO  LANE  HIGHWAY  IN  A  NO 
PASSING  AREA  MARKED  BY  A  YELLOW  STRIPE  OR  DO  NOT  PASS 
SIGN.  ■ 

PASSING  IS  PROHIBITED  ON  A  TWO  LANE  HIGHWAY  ON  A  HILL 
OR  A  CURVE  WHERE  A  VEHICLE  APPROACHING  FROM  THE 
OPPOSITE  DIRECTION  MIGHT  CREATE  A  HAZARD. 

PASSING  IS  PROHIBITED  ON  A  TWO  LANE  HIGHWAY  WITHIN 
100  FEET  OF  AN  INTERSECTION  OR  RAILROAD  CROSSING. 

Figure  2 

Edited  form  of  Figure  1. 


rpose  of  coding  lists  in  this  format  should  become 
on  the  construction  of  the  dictionary  is  explained 


The  p\|i 
quite  obvious  wVi< 
be  low . 

The  above  example  does  not  demons  urate  the  remove  ',  of  commas 


or  decimal  points  from  numbers.  The  comma  and  the  period  are  used  in 
defining  normal  breaks  in  the  text  in  the  edited  sentence  structure. 

This  should  explain  the  need  for  the  removal  of  these  symbols  in  numbers 
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Following  the  procedure  outlined  above,  the  edited  text  of 
the  data  base,  in  this  case  "Rules  of  the  Road,"  is  punched  on  cards. 
The  card  images  are  then  transformed  into  card  image  magnetic  tape 
records  for  the  "phrase  dictionary"  construction  phase  of  the  R2 
system. _ ; _ ' _ _  _  ’  _  .  ' 


i 
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VI.  CONSTRUCTION  OF  THE  "PHRASE  DICTIONARY" 

The  "phrase  dictionary"  is  very  different  from  an  ordinary 
dictionary  containing  usages,  definitions,  synonyms,  etc.  The  "phrase 
dictionary"  consists  of  groups  of  words  (termed  "phrases")  with  a 
list  of  numbers  which  reference  sentences  in  which  the  phrases  occur. 

The  phrases  follow  a  set  of  rules  described  below. 

The  card  image  records  stored  on  magnetic  tape  are  converted 
to  sentence  image  records  and  numbered  sequentially  in  ascending  order 
of  their  appearance  in  "Rules  of  the  Road".  A  WIS  index  is  performed 
on  the  sequentially  numbered  sentences  o.'  the  data  base.  The  sequen¬ 
tially  numbered  sentences  now  constitute  the  new  data  base  which  will 
hereafter  be  referred  to  as  the  data  base.  WIS  means  "word  in  sentence". 
The  name  is  derived  from  the  symbol  "KWIC"  (Keyword  in  Context)  where 
here  all  words,  not  just  keywords,  are  used  in  the  construction  of  the 
index  and  the  context  is  a  sentence .  This  portion  of  the  construction 
phase  is  performed  in  "Phrase  1"  of  the  program  "Phrase"  and  the  sort 
following. 

Consecutive  entries  of  the  WIS  index  are  compared  to  find  the 
longest  string  of  words  between  these  entries  which  match.  For  example, 
consider  the  following  WIS  index  entries  shown  in  Figure  3  at  the  top 
of  the  next  page. 

Shown  in  Figure  4,  are  the  entries  corresponding  to  the  WIS 
index  information  shown  in  Figure  3  which  have  been  processed  to  find 
the  maximal  match  between  consecutive  entries.  The  programming  for 
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this  step  of  the  construction  of  the  dictionary  is  written  in  "Phrase  2" 
of  the  program  "Phrase." 


...STOP  AT  A  FLASHING  RED  LIGHT...  437 

. . .STOP  AT  A  RED  LIGHT ...  239 

v.. STOP  AT  A  STOP  SIGN... -  625 - . - 

...STOP  BEFORE  BACKING  INTO  THE  STREET...  22 

...STOP  BEFORE  CROSSING  THE  TRACKS...  1007 

...STOP  BEYOND...  761 


Figure  3 

A  portion  of  the  WIS  index. 

STOP  AT  A  437,239,625 
STOP  BEFORE  22 , 1007 
STOP  761,1007 

Figure  4 

"Phrase  2"  application  to  WIS 
index  segment  shown  in  Figure  3. 

The  numbers  on  the  WIS  index  entries  in  Figure  3  and  the 
partially  complete  phrase  dictionary  entries  shown  in  Figure  4  represent 
the  sentences  in  which  the  respective  entries  appear. 
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The  removal  of  "prefixes"  from  the  previous  stage  Is  the  pro¬ 
gramming  effort  Involved  in  "Phrase  3"  of  "Phrase."  A  "prefix"  Is  defined 
in  the  following  manner.  If  an  entry  Is  the  beginning  of  another  entry, 
and  if  these  two  entries  have  any  sentences  numbers  in  common,  then  the 
first  entry,  since  the  entries  are  in  alphabetic  order,  is  considered  a 
"prefix."  The  numbers  in  common  between  entries  are  removed  from  the 
prefix  entry.  If  the  prefix  entry  results  with  all  sentence  numbers 
removed,  that  entry  is  deleted  since  it  is  entirely  contained  in  a  larger 
phrase.  For  an  example  of  the  programming  effort  involved  in  "Phrase  3" 
consider  the  partially  complete  dictionary  entries  shown  below  in  Figure  5. 

A  DEFT 
A  LEFT  TURN 
A  LEFT  TURN  INTO 
A  LEGAL  RESIDENT  OF 
A  LEGAL  RESIDENT  OF  ANOTHER  STATE 

Figure  5 

A  portion  of  the  results  from  "Phrase  2." 

The  output  of  "Phrase  3"  operating  on  the  input  shown  in  Figure  5  appears 
in  Figure  6  at  the  top  of  the  next  page. 


571.587.718.1081 

571.587.624.657.1081 
587,657 

24.240.243 

240.243 


n 


A  UEFT  ' 10 

A  LEFT  TURN  571,624,1081 

A  IEFT  TURN  INTO  587,657 

A  LEGAL  RESIDENT  OF  24 

A  LEGAL  RESIDENT  OF  ANOTHER  STATE  240,243 


Figure  6 

"Phrase  3"  application  to  the  data  of  Figure  5. 

Removal  of  "suffixes"  from  the  output  of  the  "Phrase  3"  constitutes  the 
programming  segment  "Phrase  4."  An  entry  is  said  to  be  a  "suffix"  if  the 
entry  is  the  ending  of  another  entry  and  if  the  two  entries  have  sentence 
numbers  in  common.  To  facilitate  the  removal  of  suffixes  in  the  phrase 
dictionary  which  has  been  constructed  thus  far,  each  entry  is  spelled 
backwards  and  the  entries  are  sorted  alphabetically  in  "Phrase  3".  "Phrase  4" 
then  operates  on  this  sorted  structure  to  remove  the  suffixes  and  restore 
the  resultant  dictionary  entries  to  normal  spelling.  An  example  of  the 
input  to  Phrase  4  with  the  resultant  output  is  shown  in  Figures  7  and  8. 


EB 

34,35,36,36,37,41 

EB 

LLIW 

34,36,37,41 

EB 

LLIW 

EREHT  _  ... 

34,36 

EB 

LLIW 

EREHT  DNA 

36 

EB 

LLIW 

SREVIRD 

41 

EB 

TSUM 

35,38,45 

EE 

TSUM 

NOITCHRTSNI 

35,38 

Figure  7 

Partial  Input  Segment  to  Phrase  4. 


WILL  BE 
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37,41 

THERE  WILL  BE  34 

AND  THERE  WILL  BE  36 

DRIVERS  WILL  BE  41 

MUST  BE  45 

...  .  INSTRUCTION  MUST  BE  35,38 

Figure  8 

Phrase  4  output  of  the 

~~  . . .  partial  input  list  of  Figure  7. 

Following  an  alphabetic  sort  to  restore  the  phrases  obtained  by 
the  removal  of  suffixes,  the  sentence  numbers  are  sorted  and  the  format  of 
the  records  are  changed  to  give  the  completed  phrase  dictionary.  Of  the 
1333  sentences  entries  in  the  data  base,  5855  dictionary  entries  were 
found.  Each  entry  is  maximal  in  length  since  suffixes  and  prefixes  are 
removed.  The  dictionary  and  data  base  are  then  ready  for  use  by  the 
strategies  for  retrieving  relevant  statements  in  answer  to  questions  over 
the  textual  information  contained  in  "Rules  of  the  Road." 


i 

i 
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VII.  THE  INITIAL  STRATEGIES  OF  R2 

The  three  basic  initial  strategy  techniques  which  have  been 
developed,  programmed,  and  tested  are  appropriately  labelled  strategy  1, 
strategy  2,  and  strategy  3,  in  the  order  of  their  development.  Strategy  1 
is  a  base  from  which  strategy  2  and  strategy  3  are  developed. 

Strategy  1,  when  given  a  statement  or  question,  first  sets  up  a 

list  of  pointers  which  point  to  the  first  character  of  every  word  in  the 

question.  For  example,  consider  the  question  in  Figure  9  below  which  is 

used  to  describe  strategy  1. 

1  2  3  4  5  6  7 

1  111  111 

WHAT  ARE  THE  RULES  OF  THE  ROAD+ 

Figure  9 

Question  with  associated  word  pointers. 

The  pointers  are  then  arranged  in  the  order  of  the  alphabetically  sorted 
words.  Hence,  the  order  of  the  pointers  for  the  example  edited  in 
Figure  9  will  be  2,  5,  7,  4,  6,  3,  1.  Note  that  not  only  are  single 
words  used  to  determine  the  ordering  of  the  pointers,  but  also  the  words 
following.  The  purpose  of  arranging  the  pointers  in  the  alphabetic  sort 
order  of  the  words  in  the  text  is  to  perform  the  dictionary  lookup  with  a 
single  pass  of  the  magnetic  tape  on  which  the  alphabetically  sorted 
dictionary  entries  are  stored.  Consider  pointer  2  which  points  to  the 
letter  "A"  in  the  word  phrase  "ARE  THE  RULES  OF  THE  R0AD+" .  The 
dictionary  is  searched  for  the  entry  "ARE."  If  "ARE"  is  found  in  the 
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dictionary,  the  sentence  numbers  associated  with  the  entry  "ARE"  are  saved. 
The  dictionary  is  searched  for  "ARE  THE,"  if  "ARE  THE"  is  found,  the 
sentence  numbers  associated  with  "ARE"  are  replaced  by  those  associated 
with  "ARE  THE."  This  process  is  continued  until  a  maximal  phrase  diction¬ 
ary  entry  is  found  for  the  associated  pointer.  The  sentences  numbers  are 

« / 

retained  only  for  the  maximal  phrase  entry  obtained  for  the  particular 
pointer..  This  process  of  finding  maximal  phrases  associated  with  each 
pointer  is  continued  until  all  pointers  and  their  associated  work  phrases 
have  been  retrieved.  The  sentence  numbers  retrieved  for  all  pointers  are 
sorted  numerically  and  a  one-pass  retrieval  of  the  sentences  is  made  from 
the  data  base.  Although  strategy  1  is  very  poor,  it  is  much  better  than  a 
straight  word  lookup  technique.  This  is  the  postulate  upon  which  the 
phrase  dictionary  construction  technique  was  formulated. 

Using  the  results  of  strategy  1,  strategy  2  retains  only  those 
maximal  phrases  and  the  associated  sentence  numbers  which  are  not  sub¬ 
phrases  of  a  larger  phrase.  For  example,  consider  again  the  question 
cited  in  Figure  9  3nd  assurte  that  "RULES  OF  THE  ROAD,"  "OF  THE  ROAD," 

"THE  ROAD,"  and  "ROAD"  are  the  maximal  phrases  associated  with  pointers 
4,  5,  6,  and  7  respectively.  Here  "ROAD"  is  a  subphrase  of  "THE  ROAD," 
"THE  ROAD"  is  a  subphrase  of  "OF  THE  ROAD,"  and  "OF  THE  ROAD"  is  a  sub¬ 
phrase  of  "RULES  OF  THE  ROAD."  By  strategy  2,  only  the  sentence  numbers 
associated  with  "RULES  OF  THE  ROAD"  would  be  retained  for  pointers  4,  5, 
6,  and  7.  The  sentences  associated  with  the  remaining  sentence  numbers 
are  retrieved  as  the  statements  relevant  to  the  question  asked. 
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Strategy  3  retains  only  those  sentence  numbers  associated  with 
the  largest  (most  characters)  maximal  phrase.  The  sentences  retrieved  are 
associated  with  a  single  phrase  as  opposed  to  several  maximal  phrases 
with  the  other  strategies. 

Another  strategy  option  (threshold  of  2)  which  increases  the 
total  number  of  strategies  to  six  is  the  following.  Using  one  of  the 
three  strategies  above,  only  retrieve  those  statements  which  are  referenced 
two  or  more  tiroes.  This  deletes  many  of  the  would-be  retrieved  state¬ 
ments,  but  also  often  deletes  a  relevant  statement. 

A  second  strategy  option  (ENS)  which  increases  the  total  number 
of  possible  strategies  to  twelve  is  the  following.  Note  that  this  option 
may  be  used  with  the  option  above.  In  the  case  in  which  both  options  are 
exercised,  the  second  strategy  option  is  performed  first  and  the  first 
option  second.  The  second  strategy  option  retrieves  sentences  numbered 
n-1,  n,  itfl  where  n  represents  a  sentence  number  retrieved  by  strategy  1, 
strategy  2,  or  strategy  3,  which  ever  is  applied  to  the  question.  This 
option  retrieves  more  information,  while  the  first  reduces  the  amount 
retrieved.  The  idea  here  is  that,  in  the  text,  sentences  which  lie 
adjacent  to  a  given  sentence  will  possibly  contain  additional  information 
relevant  to  the  given  sentence  because  Of  the  paragraph  structure  of  the 
text. 

A  strategy  relevancy  rate  to  determine  which  of  the  twelve 
strategies  is  the  best  strategy  has  been  defined.  Th it  relevancy  rate 

R 

1  E+N’ 


(Rx)  is 


where 


/ 


■  relevancy  rate, 

N  *  number  of  relevant  statements  retrieved,  and 

E  ■  number  of  irrelevant  statements  retrieved. 

Using  this  strategy  relevancy  rate,  strategy  2  with  the  option 
Threshold  of  2  is  the  best  strategy.  This  strategy  has  a  relevancy  rate 
of  approximately  .25  for  some  20  questions  asked  over  the  data  base. 
However,  the  best  results  for  a  particular  question  may  come  from  use  of 
a  different  strategy  than  strategy  2  with  a  threshold  of  2. 

Although  the  relevancy  rate  is  quite  low  using  the  present 
technique,  a  second  relevancy  rate  has  been  defined.  The  purpose  of  the 
addition  of  a  second  relevancy  rate  is  that  does  not  penalize  a  par¬ 
ticular  strategy  for  retrieving  only  a  few  of  the  relevant  answers  con¬ 
tained  in  the  data  base.  The  second  strategy  relevancy  rate  R^  is 
defined  to  penalize  a  strategy  which  does  not  retrieve  all  relevant 
answers  to  the  question  which  is  contained  in  the  data  base.  The  formula 


for  R2  is 


where 


R^  =■  strategy  relevancy  rate, 

N  =  number  of  relevant  statements  retrieved, 

E  -  number  of  irrelevant  statements  retrieved,  and 

A  =  number  of  relevant  statements  to  the  question 

contained  in  the  data  base. 
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The  relevancy  rates  are  computed  by  hand  for  R^.  This  is  a 
major  effort  since  the  entire  data  base  mu;t  be  scanned  for  all  state¬ 
ments  relevant  to  a  particular  question. 

A  number  of  examples  of  using  the  strategies  discussed  are 
given  in  Appendix  D. 
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VIII.  CONCLUSION  AND  PROPOSAL  FOR  RESEARCH 


The  work  presented  in  this  paper  represents  the  first  step  in 
the  development  of  the  R2  question-answering  information  retrieval  system. 
It  indicates  that  information  retrieval,  systems  with  natural  language 
communication  on  all  levels  can  be  successfully  implemented.  The  initial 


R2  system  has  already  introduced  a  number  of  new  features  that  will  aid  in 
the  implementation  of  the  total  system. 

First,  the  system  is  data-base  independent.  That  is,  the  imple¬ 
mentation  described  would  have  worked  equally  well  on  any  other  coherent 


textual  database  without  any  modification  to  the  programs.  Strategy  2 

with  a  thr  .old  of  2  has  R^  *  .25. 

Second,  the  maximal  phrase  concept  has  defined  a  neT>  approach 

to  natural  language  interpretation.  The  questions  posed  to  the  system 

were  not  analyzed  on  a  syntactic  level.  This  means  there  was  no  attempt 

made  to  determine  the  structure  of  the  question  other  than  the  relationship 
•  0 

of  the  constituent  maximal  phrases  to  the  statements  of  the  data-base. 

This  technique  has  the  obvious  advantage  of  not  acquiring  the  ambiguity 

involved  in ^syntactic  analysis  and  yet  ektracting  important  relationships 

V  f  .  ... 

between  the  question  and  the  data-base. 

_ _ _ _ There  are  a  number  of  ways  in  which  the  present  system  may  be 

clearly  improved:  (1)  Allowing  paragraphs  and  chapters  to  be  treated  as 
unifying  entities,  (2)  Recognition  of  hyphenated  words,  (3)  Replacement 

capability  to  accommodate  synonyms  with  possible  relational  structures 

■ 

utilizing  feedback,  and  (4)  Sensitivity  to  pluralization  and  other  variant 


word  forms. 
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The  next  phase  of  development  should  deal  with  methods  of 
bringing  into  play  syntactic  analysis  in  the  various  levels  of  the 
system;  for  interpretation  of  the  question,  for  structuring  the. data  base, 
and  for  the  eventual  process  of  inducing  and  synthesizing  the  resultant 
responses  of  the  system.  The  addition  of  this  capacity  should  greatly 
enhance  the  ability  of  the  system  to  deal  with  natural  languages. 
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Appendix  A  contains  the  following  information  in  the  order  listed  below: 

(1)  a  brief  description  of  the  programs  for  the  construction  of 
the  "phrase  dictionary", 

(2)  flow  charts  of  the  programs  for  the  construction  of  the  "phrase 
dictionary",  and 

(3)  instructions  for  the  use  of  the  construction  programs  for  the 
CDC  1604  computer  in  the  Coordinated  Science  Laboratory. 
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a 

.  / 

/ 

MAIN  PROGRAMS 

PHRASE  I  -  This  main  program  calls  the  following  programs  for  execution 
in  the  order  given: 
l  1.  MESG1 

_} _ 2-  DELPG  ' 

3 .  MAKES 
4*  THREE PA 

5.  NUMBER 

6.  FXRLGl 

7.  QADPRE 

8 .  PREPSORT 

9.  MESE2 

PHRASE  1  is  used  to  edit  the  input  and  made  sentences  of  the  edited  input 
data.  Following  the  editing,  the  WIS  Index  is  produced  from  the  sentences 
PHRASE 2  -  This  main  program  which  follows  the  first  alphabetic  sort  follow 
ing  PHRASE  1,  calls  tlie  following  programs: 

1.  MESG1 

2 .  PHRASER 

3 .  COMBINE 

. . .  ' .  .  4.  REMTAIL  .  '  ~  "  '  - . -  ~ -  — - - - 

5 .  REMPREF 

6.  FXRLG2 

7  PREPSORT 


8.  MESG2 
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PHRASE 2  first  determines  all  maximal  phrases  in  the  data  base.  Prefixes 
are  then  removed. 

PHRASE 3  -  This  main  program  which  follows  a  CO-OP  monitor  sort  removes 
duplicate  prefix  entries  from  the  output  of  PHRASE2  and  sets  up  the 
phrases  in  backwards  form  for  the  removal  of  suffixes.  The  program  sub¬ 
routines  incorporated  in  PHRASE3  ate  as  follows: 

1.  MESGl 

2.  REMDUP 

3 .  BACKADD 

4.  FXRLG2 

5.  PREPS ORT 

6.  MESG2 

PHRASE4  -  This  main  program  which  follows  the  third  sort  is  made  up  of 
the  following  subroutines: 

1.  MESGl 

2 .  REARNGE 

3 .  REMSUFF 

4 .  REMDROP 

5.  MESG2 

PHRASE4  removes  the  suffixes  from  the  data  base  and  prepares  the  output 

_ records  in  final  form. _ _ _ _ 

PHRASE5  -  Following  a  special  sort  at  the  end  of  PHRASE4,  the  phrase 
dictionary  is  in  completed  final  form.  PHRASE5  puts  the  output  of 
NUMBER  in  final  form.  PHRASE 5  consists  of  the  program  RENUMBER. 


SUBROUTINES 


DELPG  -  This  subroutine  removes  the  page  number  from  eac$_ 
record.  The  input  records  are  the  output  records  of  IBM 
MAKES  -  This  subroutine  follows  DELPG  and  removes  all  oc 
multiple  blanks  as  it  constructs  sentence  image  records 


will  end  with  a  period(.),  a  question  mark(coded  as  +)  , 
periods  (...) . 

THREEPA  -  This  subroutine  operates  on  the  output  of  MAKES 


ISL  card  image 

::sli. 

|urrences  of 
All  sentences 
dr  ellipsis 


phrases  beginning  with  an  asterisk  to  the  previous  senteh 

l;  . . 

ellipsis  periods.  The  ellipsis  periods  are  removed  with 
and  a  blank  is  inserted  between  phrases.  All  occurrence 
dashes,  and  hyphens  (-)  are  removed  and. replaced  with  blk 
NUMBER  -  The  subroutine  numbers  each  record  sequentially 
48  bit  BCD  number  at  the  beginning  of  each  sentence. 
FXRLGl  -  The  subroutine  operates  on  each  record  of  the  o 
to  produce  records  of  a  fixed*1  length.  The  fixed  length 
length  of  the  longest  record  from  the  output  of  NUMBER, 
left  justified  with  blanks  ifight  to  fill  out  the  record. 

t  i1 

QADPRE  -  Operating  on  the  output  of  FXRLGl,  this  subrout 
WIS  index.  The  output  records  are  left  fixed  in  length 
equal  to  the  length  of  those  in  FXRLGl. 

PREPSORT  -  This  subroutine  sets  up  the  parameters  and  ca 
to  write  a  CO-OP  Monitor  file  to  use  the  CO-OP  Sort  Rout 
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to  append  all 
;ce  having 
the  asterisks, 
of  minuses, 
nks .  ' 

by  placing  a 


>■  .ltput  of  NUMBER 
is  equal  to  the 
The  records  are 

ine  produces  the 
with  a  length  . 

Lis  SORTPROG 
Lnes. 
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SORTPROG  -  This  subroutine  is  a  modified  ILLAR  subroutine  to  write  a 
CO-OP  Monitor  record  to  be  used  for  the  CDC  CO-OP  Monitor  sort  routines. 
PHRASER  -  This  subroutine  uses  the  fixed  length  alphabetically  sorted 
sentence  records  from  PHRASE  1  as  input.  Consecutive  sentences  are  com¬ 
pared  to  find  the  longest  character  match.  When  a  match  is  found,  the 
phrase  and  the  associated  sentence  numbers  are  written.  Each  entry  is  also 
compared  to  the  previous  entry  written.  If  it  is  identical,  the  sentence 
number  alone  is  written. 

COMBINE  -  This  subroutine  takes  the  output  of  PHRASER  and  appends  to  the 
phrase  entry,  with  its  two  sentence  numbers,  all  those  sentence  numbers 
which  follow  up  to  the  next  phrase. 

REMTAIL  -  This  subroutine  removes  the  blanks  from  the  end  of  the  phrases, 
shortening  the  record  length,  and  moves  the  sentence  numbers  immediately 
following  the  phrase. 

REMPREF  -  This  subroutine  operates  on  the  shortened  REMTAIL  output  to 
remove  prefixes. 

FXRLG2  -  This  subroutine  fixes  the  record  length  in  preparation  for  a 
CO-OP  Sort.  The  phrases  are  fixed  in  length  as  well  as  the  sentence 
numbe  rs . 

REMDUP  -  This  subroutine  operates  on  the  sorted  output  of  PHRASE2  to 

remove  duplicate  prefix  entries. - -  - 

BACKADD  -  This  subroutine  follows  REMDUP  and  inverts  the  prefix  phrasers 
character  for  character.  The  output  records  contain  both  the  backward 
and  forward  phrases  and  their  sentence  numbers. 


REARNGE  -  This  subroutine  rearranges  the  sorted  output  of  PHRASE 3  to  put 
the  phrases  in  the  final  form.  The  BCD  sentence  numbers  are  converted 
to  binary. 

REMSUFF  -  This  subroutine  removes  the  suffixes  from  the  data  base  by 
removing  sentence  numbers. 

REMDROP  -  This  subroutine  drops  the  backwards  phrase  from  the  output  of 
REMSUFF. 

RENUMBER  -  This  subroutine  operates  on  the  output  of  NUMBER  to  replace 

the  BCD  sentence  numbers  with  the  binary ^equivalent .  _ _ 

NICETYPE  -  This  subroutine  can  be  used  to  print  the  phrase  dictionary. 
MERGER  -  This  subroutine  compares  two  strings  to  determine  which  of  the 
two  occurs  first  alphabetically. 

SORTl  -  This  subroutine  is  a  specialized  variable  record  length  alpha¬ 
betic  sort. 

MERGE2  -  This  subroutine  is  a  specialized  alphabetic  merge  routine  which 
is  used  by  SORTl  to  alphabetically  sort  an  input  file. 

COMPARE  -  This  subroutine  compares  two  strings  character  for  character 
and  returns  with  the  number  of  characters  which  match. 


2S 


MESSAGES  TO  OPERATOR  SUBROUTINES 

CHOICE  -  This  subroutine  which  is  called  when  an  end-of-file  is  read  asks 
the  operator  if  there  is  more  input  or  if  output  is  to  be  terminated.  If 
there  is  more  input,  the  operator  is  instructed  to  mount  a  specified  tape. 
GIVEMES  -  This  subroutine  informs  the  operator  on  which  units  input  and 
output  tapes  are  to  be  mounted. 

MESGl  -  This  subroutine  tells  the  operator  to  mount  several  tapes  on 
the  tape  units  in  preparation  for  the  beginning  of  Phrase  X,  where 
X  *  1,2, 3, 4. 

MESG2  -  This  subroutine  requests  operator  to  remove  and  mount  specified 
tapes  on  the  tape  units  at  the  end  of  Phrase  X,  where  X  =  1,2, 3, 4  in 
preparation  for  a  CO-OP  sort  or  at  the  end  of  Phrase  4,  for  a  specialized 
sort. 

SPECMESI  -  This  subroutine  requests  operator  to  mount  a  tape  on  a  speci¬ 
fied  tape  unit. 

SPECMESO  -  This  subroutine  requests  operator  to  remove  and  label  a  tape 
from  a  specified  tape  unit. 

SPECWRIT  -  This  subroutine  calls  the  ISL  write  routine  to  write  the 
specified  record.  On  an  end-of-tape  condition,  the  operator  is  requested 
to  remove  and  label  the  full  tape  and  mount  a  new  tape. 

T0NE1  -  This  subroutine  generates  an  audible  tone  indicating  man-machine 
interaction  is  required. 

TYFEMES  -  This  subroutine  will  type  a  string  message  to  the  operator  on 
the  console  typewriter. 
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FLOW  CHARTS 


ANT- 

ANNEX+1 


FR-1904 


C0M9NE 


REMTAIL 
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RENUMBER - 1  I - -NICETYPE — 1 


SPECMESO - - SPEC  WRIT 
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INSTRUCTIONS  FOR  THE  CONSTRUCTION  OF  THE  PHRASE  DICTIONARY 

1.  Mount  tape  C-140  (ISL  Master)  on  logical  unit  1. 

2.  Mount  tape  C-99  (Dictionary  Construction  Programs)  on  logical  unit  4. 

3.  Mount  the  edited  source  input  tape  on  logical  unit  3. 

4.  Mount  a  scratch  tape  on  logical  unit  2. 

5.  Press  "Autoload."  _ _ _ 

6.  When  the  typewriter  returns  with  the  sign"#",  type:  "load, 4  cr" 
where  "cr"  indicates  a  carriage  return. 

7.  When  the  typewriter  again  returns  with  type:  "go,  phrasel  cr". 

8.  Follow  the  instructions  given  on  the  console  typewriter. 

9.  When  "end  phrasel"  appears,  mount  the  tape  labelled  SI  on  logical 
unit  3,  remove  all  other  tapes,  except  the  scratch  tape  on  logical 
unit  2. 

10.  Mount  tape  7  on  logical  unit  1  and  press  "Autoload." 

11.  When  the  "*"  returns  on  the  typewriter,  type  "cr".  When  the  "." 
returns,  type  "m.cr".  Follow  the  instructions  given  on  the  type¬ 
writer.  The  SORT/REFERENCE  manual  can  be  used  for  the  methods  of 
treating  errors  in  this  step. 

12.  When  the  job  is  complete,  mount  the  output  tapes  (label  as  Tl,T2,...) 
on  logical  unit  8. 

13.  Mount  C-140  and  C-99  as  in  steps  1  and  2  above. 

14.  Follow  the  instructions  given  in  steps  5,6,7,8,9,10,11,12,  changing 
step  7  each  time  to  "go,  phrase2",  "go,phrase3",  and  finally  "go, 
phrase4" 
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15-  When  the  typewriter  returns  with  "#"  after  the  statement  "end  phrase4" 
type:  "call,4,sortl  cr". 

16.  Mount  the  tape  labelled  SI  on  logical  unit  8. 

17.  Type:  "go,sortl  cr". 

18.  Remove  the  output  tape  from  logical  unit  3  --  this  is  the  phrase 
dictionary. 

19.  Type:  "go,phrase5  cr"  after  the  "#"  appears. 

20.  The  edited  data  base  is  on  logical  unit  7  when  the  "#"  reappears. 

21.  Label  the  tapes  from  steps  18  and  20  with  appropriate  labels  and 
remove  write  rings. 


49 


APPENDIX  B 


INSTRUCTIONS  FOR  THE  INITIAL  STRATEGIES 


5 


i 


Instructions  for  the  operation  of  the  strategies  are  given  below. 

1.  Mount  tape  0140  on  logical  unit  1. 

2.  Press  "Autoload". 

3.  Mount  D-99  on  logical  unit  2  and  mount  D-98  on  logical  unit  3. 

4.  Typer  "load, 2 ,3 (or)" . 

5.  After  the  sign,  type:  go,runallst(cr)" . 

6.  State  a  question  followed  by  a  "7,"  sign. 

7.  Give  a  strategy  using  the  following  code 

AiB 2P2  '  * 

where 

A^  *  1,2,3  for  strategy  1,  strategy  2,  or  strategy  3,  respectively. 

B.  =  N  or  Z,  N  representing  that  the  second  strategy  option  "ENS" 
will  be  exercides,  or  Z ,  it  will  not  be  exercised. 

*  1  or  2,  2  indicates  that  the  threshold  of  2  option  will  be 
exercised. 

*  space 

The  7.  sign  must  follow  the  last  AJ5X  sequence  which  can  be  any 
length,  i.e.,  i  **  1,2,. ..,6. 

8.  By  typing  "SAME"  when  the  word  "Question"  is  typed,  the  previous 
question  which  was  entered  will  be  used. 

9.  . To  terminate  use  of  the  R2  system,  type  "ABORT"  when  the  word  "QUESTION1 


is  typed. 
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A  PORTION  OF  THE  PHRASE  DICTIONARY 
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A  sample  of  the  "phrase  dictionary"  for  the  R2  system  with 
"Rules  of  the  Road"  as  the  data  base  is  shown  below. 

DRIVERS  ARE  PROHIBITED  FROM  -  646,686,739 

DRIVERS  ARE  REQUIRES  -  378,1019 

DRIVERS  LICENSE  -  33 

DRIVERS  MAY  -  532,777 

DRIVERS  MUST  -  577,668,689,1011 

DRIVERS  MUST  ALWAYS  -  569,579 

DRIVERS  MUST  FIRST  -  555,573 

DRIVERS  MUST  YIELD  THE  RIGHT  OF  WAY  TO  -  571,609 

DRIVERS  MUST  YIELD  TO  -  607,581 

DRIVERS  MUST  YIELD  TO  PEDESTRIANS  -  567,575 

DRIVERS  OF  -  450,557,560,1073,1299 

DRIVERS  TO  -  404,413,634,687,1023 

DRIVERS  WHO  -  168,1164 

DRIVERS  WHO  ARE  -  149,605 

DRIVERS  WILL  BE  -  34,35 

DRIVES  -  1189,1211,1284 

DRIVEWAY  -  837,837 

DRIVEWAYS  -  808 

_ P.!^Y:^5_“_A*r6J.,77  »  152, 203 ,208,209,283 ,453  ,453 ,594,645,949,949,1212,1212 

DRIVING  A  -  101,106 

DRIVING  ABILITY  -  1172,1172,1173,1155,1195,1200,1208 
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Examples  of  the  strategies  are  shown  below. 

Examples  1,  2,  and  3  show  three  different  strategies  applied  to 
the  question 

"An  octagon  sign  always  means  to  stop?" 

The  abbreviations  shown  following  the  questions  indicate  the 

following: 

ST1  =  strategy  1 
ST2  =  strategy  2 
ST3  =  strategy  3 

THl  =  threshold  of  two  option  not  exercised 
TH2  =  threshold  of  two  option  exercised 
N-l,  N,  N+l  =  ENS  option  exercised 

The  asterisks  to  the  left  of  a  sentence  indicate  those  retrieved 
statements  which  are  relevant. 

Examples  4  and  5  serve  to  indicate  the  need  fcr  the  second 
relevancy  rate,  R^.  In  example  5,  there  are  two  relevant  answers  retrieved 
These,  in  fact,  are  the  only  two  relevant  answers  contained  in  the  data 
base.  With  R^ ,  the  strategy  used  in  Example  4  is  not  penalized  for  having 
retrieved  only  one  of  the  two  relevant  answers.  With  R^,  the  stragety  is 
appropriately  penalized. 


AN  OCTAGON  SIGN  ALWAYS  MEANS  TO  STOP 


STI,  TH2 

*THE  EIGHT  SIDED  (OCTAGON)  SHAPE  ALWAYS  MEANS  STOP. 
A  ROUND  SIGN  ALWAYS  MEANS  RAILROAD  CROSSING. 


Ill' 


THIS  SIGN  TELLS  YOU  TO  LOOK,  LISTEN  AjND  SLOW  DOWN  BECAUSE  YOU  MAY 
TO  STOP. 

*• 

IF  A  TRAIN  IS  AFPROACHING  STOP, 

STOP, 

PASSING  IS  PROHIBITED  ON  A  TWO  LANE  HIGHWAY  IN  A  NO  PASSING  AREA  HARKED 
BY  A  YELLOW  STRIFE  OR  A  DO  NOT  PASS  SIGN. 


RAILROAD  CROSSINGS  ARE  ILLEGAL  WHEN  A  FLAGMAN  IS  GIVING  A  SIGNAL 

EXAMPLE  1 
'  » 

AN  OCTAGON  SIGN  ALWAYS  MEANS  TO  STOP 


ST2,  TH2  | 

in;. 

*THE  EIGHT  SIDED  (OCTAGON)  SHAPE  ALWAYS  MEANS  STOP. 

A  ROUND  SIGN  ALWAYS  MEANS  RAILROAD  CROSSING.  . . . ; - “ 

THIS  SIGN  TELLS  YOU  TO  LOOK,  LISTEN  AND  SLOW  DCWN  BECAUSE  YOU  MAYj  HAVE 
TO  STOP. 

PASSING  IS  PROHIBITED  ON  A  TWO  LANE  HIGHWAY  IN  A  NO  PASSING  AREA  HARKED 
BY  A  YELLOW  STRIPE  OR  A  DO  NOT  PASS  SIGN. 

RAILROAD  CROSSINGS  ARE  ILLEGAL  WHEN  A  FLAGMAN  IS  GIVING  A  SIGNAL  TO  STOP 
RI  “  R2  "  5 


55 


HAVE 


TO  STOP. 


EXAMPLE  2 
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AN  OCTAGON  SIGN  ALWAYS  MEANS  TO  STOP 

ST3 ,  THI 

*THE  EIGHT  SIDED  (OCTAGON) SHAPE  ALWAYS  MEANS  STOP. 

A  ROUND  SIGN  ALWAYS  MEANS  RAILROAD  CROSSING. 


EXAMPLE  3 


IS  IT  LEGAL  TO  CROSS  A  DOUBLE  YELLOW  LINE  TO  COMPLETE  A  PASS+ 

ST  1 ,  TH2 

♦CROSSING  A  DOUBLE  YELLOW  IS  PROHIBITED  EXCEPT  WHEN  TURNING  INTO  A  DRIVEWAY. 


FXAMPLE  4 


IS  IT  LEGAL  TO  CROSS  A  DOUBLE  YELLOW  LINE  TO  COMPLETE  A  PASS+ 
ST2 ,  THI 

SERVILE  PERSONK—  ^HE  uS  k.'iu  RES IIL- 1. * j  jz 

ILLINOIS  ARE  GIVEN  A  30  DAY  GRACE  PERIOD  FOLLOWING  THEIR  RETURN  TO  THE 
CONTINENTAL  LIMITS  OF  THE  UNITED  STATES. 


TWO  REQUIRED  (ONE  ON  MOTORCYCLES),  WITH  WHITE  OR  YELLOW  TINTED  LIGHTS 
VISIBLE  FOR  AT  LEAST  500  FEET. 

TWO  YELLOW  LIGHTS,  ONE  ON  EACH  UPPER  FRONT  CORNER,  VISIBLE  FOR 
500  FEET. 

ONE  YELLOW  REFLECTOR  ON  THE  LOWER  LEFT  HAND  AND  RIGHT  HAND  FRONT 
CORNERS . 

THIS  ONE  IS  USED  ON  TWO  LANE  ROADS  AND  IT  WARNS  DRIVERS  THAT  THEY  ARE 
APPROACHING  AN  AREA  WHERE  TWO  CARS  CANNOT  SAFELY  PASS  EACH  OTHER  WITHOUT 
SLOWING  DOWN. 


1REF.E  ARE  THREE  TYPES  FOUR  OR  MORF  LANFS,  BOUBLF  SOLID  v:.LLO*-’  STRIPES. 

*CROS?  TNG  A  DOUBLE  YELLOW  IS  PROHIBITED  EXOE f I  WHEN  TURNING  INTO  A 
DRIVEWAY. 

^DRIVERS  MAY  CRuSS  THE  YELLOW  STRIPE  C C:."ZK  A  PASSING  I&NEUVER 

WHICH  WAS  STAP.IEJ  BEFORE  THE  BEGINNING  OF  A  !0  PASSING  ZONE,  NO _ 

PASSING  STRIPE  MAY  ALSO  BE  CROSSED  WHEN  MAKING  A  LEFT  TURN  INTO  A  DRIVE¬ 
WAY. 

A  YELLOW  LINE  EXTENDS  THE  ENTIRE  DISTANCE  TO  I RE VENT  CROSSING  OVER, 

AND  TWO  WHITE  STRIPES  ARE  PAINTED  ON  EACH  SIDE  OF  THE  TRACK. 

IN  URBAN  AREAS  THE  LINE  IS  USUALLY  PLACED  FROM  THREE  TC  FIVE  FEET  IN 
ADVANCE  OF  THE  CROSSWALK. 

YELLOW  LINES  AND  WHITE  DIAGONAL  STRIPES  ARE  USED  TO  MARK  FIXED 
OBSTRUCTIONS  OR  TO  CHANNEL  TRAFFIC  INTO  DIFFERENT  LANES. 

THEY  ARE  DEVELOPED  THROUGH  CAREFUL  STUDY  BY  TRAFFIC  ENGINEERS,  SAFETY 
EXPER^f Irn  l*!Lu  AUTHORITIES,  AND  ONLY  BY  ^ICT  OBSERVANCE  CAN  »E  EXPECT 
TO  TRAVEL  WITH  A  REASONABLE  DEGREE  OF  SAFETY  AND  SPEED  ON  OUR  .ROWD^D, 
COMPLEX  STREETS  AND  HIGHWAYS . 

TF  HE  IS  WITHIN  AN  INTERSECTION  CONTROLLED  BY  A  SIGNAL  LIGHT  HF,  MAY 
COMPILE® !S  T^WHEN  THE  LIGHT  TURNS  RED,  BUT  IF,  HE  HAS  NOT  YET  ENTERED 
THE  INTERSECTION  HE  MUST  WAIT  FOR  THE  NEXT  GREEN  LIGHT . 

PASSING  IS  PROHIBITED  ON  A  TWO  LANE  HIGHWAY  IN  A  NO  PASSING  AREA 
MARKED  BY  A  YELLOW  STRIPE  OR  A  DO  NOT  PASS  SIGN. 

IF  YOU  PASS  THE  SAME  SPOT  BEFORE  YOU  ARE  THROUGH  COUNTING  YOU  ARE 
FOLLOWING  TOO  CLOSELY. 

ELECTRICAL  TURN  SIGNALS  AND  THE  FLASHING  OF  ELECTRIC  TURN  SIGNALS  AS 
A  COURTESY  OR  DO  PASS  INDICATION  TO  OTHER  DRIVERS  IN  THE  REA.,  IS  PROHIBITED 

BY  LAW. 

IT  IS  NOT  NECESSARY  TO  STOP  FOR  A  SCHOOL  BUS  ON  A  CONTROLIED  ACCESS 
HIGHWAY  IF  THE  BUS  IS  IN  A  LOADING  ZONE  AT  A  PLACE  WHERE  PEDESTRIANS  ARE 
NOT  PERMITTED  TO  CROSS. 

USE  THE  WHITE  STRIPE  AT  THE  EDGE  OF  THE  PAVEMENT  AS  A  GUIDE  LINE . 

THIS  DESIGN  FEATURE  ENABLES  VEHICLES  TO  CROSS,  ENTER  OR  LEAVE  EITHER 
HIGHWAY  WITHOUT  INTERFERING  WITH  OTHER  VEHICLES . 

WHEN  THE  WEATHER  IS  BAD  OR  THE  PAVEMENT  IS  SLICK,  DOUBLE  OR  TRIPLE 
THE  INTERVAL. 
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A  NEW  INEXPERIENCED  PASSENGER  SHOULD  PE  INSTRUCTED  AS  FOLLOWS  THAT 
RAILROAD  TRACKS  OR  STEEL  BRIDGE  EXPANSION  JOINTS  PRESENT  A  SPECIAL  PROD!?’ 
TRY  TO  CROSS  THEM  AT  AN  ANGLE,  IF  POSSIBLE,  TO  AVOID  SKIDDING  OR  CATCHING 
THE  WHEELS. 

THESE  ARE  AREAS  FOR  COMPLETE  HONESTY  BETWEEN  THE  PHYSICIAN  AND 
PATIENT.  -  .  ...  _ _  _ _ _ - . .  . . . . . 

R  JK  -1—  t>  m  — — • 

1  11  2  11 


EXAMPLE  5 


DOCUMENT  CONTROL  DATA  -  R  &  D 

tSfcurity  <•/•*  «ific  mtron  cf  (to  ff  t>f  .»#>sfri*r  f  miu)  indr*in£  ttnnofnti<#i  mu*t  by  »hpr»  the  ov»f  >/  feporf  Is  c/».T*<f<»d> 
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